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Background: Evidence is needed about the promptness of cancer diagnosis and associations between its measures. 

Methods: We analysed data from the National Audit of Cancer Diagnosis in Primary Care 2009-10 exploring the association 
between the interval from first symptomatic presentation to specialist referral (the primary care interval, or 'interval' hereafter) and 
the number of pre-referral consultations. 

Results: Among 13035 patients with any of 18 different cancers, most (82%) were referred after 1 (58%) or 2 (25%) consultations 
(median intervals 0 and 1 5 days, respectively) while 9%, 4% and 5% patients required 3, 4 or 5 + consultations (median intervals 34, 
47 and 97 days, respectively) (Spearman's r= 0.70). The association was at least moderate for any cancer (Spearman's r range: 0.55 
(prostate) — 0.77 (brain)). Patients with cancers with a higher proportion of three or more pre-referral consultations typically also 
had longer median intervals (e.g., multiple myeloma) and vice versa (e.g., breast cancer). 

Conclusion: The number of pre-referral consultations has construct validity as a measure of the primary care interval. Developing 
interventions to reduce the number of pre-referral consultations can help improve the timeliness of cancer diagnosis, and 
constitutes a priority for early diagnosis initiatives and research. 



In spite of its potential importance (Richards et al, 1999; Thomson 
and Forman, 2009; T0rring et al, 2011) there is currently no 
uniform approach to measuring the timeliness of cancer diagnosis. 
The time between the first symptomatic presentation of a cancer 
patient to a general practitioner and their first specialist referral for 
further investigation (i.e., the 'primary care interval') is a relatively 
established measure (Allgar and Neal, 2005; Neal and Allgar, 2005; 
Hansen et al, 2011; Weller et al, 2012). The number of 



consultations with a general practitioner before hospital referral 
is increasingly being used as a measure of the promptness of cancer 
diagnosis (Pancreatic Cancer UK, 2011; Rarer Cancer Foundation, 
2011; Rubin et al, 2011; The Roy Castle Lung Cancer Foundation, 
2011; Anonymous, 2012; Lyratzopoulos et al, 2012; Teenage 
Cancer Trust, 2012). 

Both measures (i.e., both the primary care interval and the 
number of pre-referral consultations) have specific strengths and 
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weaknesses, some of which are shared (see Online Supplementary 
Information, Table). Exploring whether and how the two measures 
are associated is important: If strongly correlated, both or either can 
be used for research and quality surveillance; if weakly correlated, 
using the number of pre-referral consultations as a measure of 
timeliness should be discouraged. Importantly, if the number of pre- 
referral consultations is a valid surrogate of the primary care 
interval, earlier diagnosis efforts could focus on improving the 
sensitivity of symptom appraisal by general practitioners during a 
medical consultation, for example, using clinical decision support 
tools (Hamilton, 2009; Hippisley-Cox and Coupland, 2012). We 
therefore examined the association between the number of pre- 
referral consultations and the primary care interval. 



MATERIALS AND METHODS 



We analysed data from the (English) National Audit of Cancer 
Diagnosis in Primary Care (2009-2010), undertaken as part of the 
National Awareness and Early Diagnosis Initiative (Cancer 
Research UK, 2009; Rubin et al, 2011). Data were collected by 
general practitioners or other professionals in an estimated total of 
1170 general practices (~14% of all practices in England) who 
participated voluntarily. Comparisons with cancer registration 
statistics indicate good representativeness (Rubin et al, 2011). We 
analysed data on patients aged 15 years or older with completely 
observed information on number of pre-referral consultations and 
primary care interval values from 0 to 730 days. Because of sample 
size considerations, analysis was restricted to patients with the 18 
most numerous cancers. 

We calculated the median primary care interval (in days) and 
inter- quartile range for different numbers of pre-referral consulta- 
tions. This was done both for all patients and separately by cancer. 
Box plots were used to further illustrate these data. Given the right- 
skewed nature of primary care interval data, we calculated the 
Spearman's rank correlation co-efficient of the two measures. 
Subsequently, we calculated the receiver-operator characteristic 
(ROC) area under the curve (AUC), treating the primary care 
interval as a continuous variable and the number of pre-referral 
consultations as a binary variable ('three or more' vs 'one or two' 
consultations — as used by UK policy makers (NHS, 2011)). 

Using linear regression we explored whether the association 
between the two measures varied between different patients 
groups. Owing to data non-normality, significance testing 
was based on bootstrapping (1000 samples). See also Online 
Supplementary Information. 



RESULTS 



Among 13 035 patients included in the analysis the median (inter- 
quartile range) primary care interval was 5 (0-23) days. Most 
(82%) were referred after 1 (57.5%) or 2 (24.6%) consultations, 
with median primary care interval (inter-quartile range) of 0 (0-3) 
and 15 (7-31) days, respectively. Of the 18% that required 3 
(9.2%), 4 (3.9%) or '5 or more' (4.8%) consultations, the median 
primary care interval (inter-quartile range) was 34 (16-64), 47 
(27-90) and 97 (46-173) days, respectively (Table 1, Figure 1). 
Similar patterns were observed for patients with any of the 18 
cancers (Table 1). Patients with multiple myeloma and lung cancer 
had high proportions of three or more pre-referral consultations 
(46% and 33%, respectively) and long median primary care 
intervals (21 and 14 days, respectively). Patients with breast cancer 
and melanoma had the lowest proportion of three or more pre- 
referral consultations (3% and 5%, respectively) and the shortest 
median primary care intervals (0 days for both). 
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Figure 1. Box plot for primary care interval by category of number of 
pre-referral consultations (1 , 2, 3, 4 and '5 + ') for patients with any of 1 8 
cancers (n = 1 3 035). 

For patients with any of the 18 cancers the Spearman's r was 
0.70 (P< 0.0001) and the ROC AUC was 0.88 (95% confidence 
interval: 0.87-0.89) (Table 2). Primary care interval cutoff values of 
either 17 or 18 days have sensitivity and specificity of 0.80 or 
higher for predicting pre-referral consultation category. 

Using linear regression we found no evidence for interactions 
between the number of pre-referral consultations and age, sex or 
ethnicity (P= 0.998, P = 0.261 and P = 0.691, respectively), but 
strong evidence for interaction with cancer type (P< 0.001). 
Nevertheless, the association was at least moderately strong for 
each cancer (Spearman's r range: from 0.55 to 0.77 for prostate and 
brain cancer, respectively, Table 2). There was evidence for an 
interaction between the number of pre-referral consultations and 
different referral types (P= 0.016), however the association was 
strong for any referral type (Spearman's r range: from 0.67 to 0.72 
for routine and '2-week' referrals, respectively, Table 2). See also 
Online Supplementary Information. 



DISCUSSION 



Using data from the English National Audit of Cancer Diagnosis in 
Primary Care we found that the number of pre-referral consulta- 
tions has construct validity as a measure of the primary care 
interval. The association between the two measures was strong for 
patients with any type of hospital referral and either moderate or 
strong for patients with any of the studied cancers. Patients with 
cancers requiring greater number of consultations tended to have 
longer primary care intervals (e.g., multiple myeloma) and vice 
versa (e.g., breast cancer). 

The findings allow us to gain some insight into the potential 
reduction in primary care interval that could be achievable by 
reducing the number of pre-referral consultations. For example, 
the median primary care interval for patients with 'five or more' 
pre-referral consultations was 49.5, 62.5 and 81.5 days longer than 
those with four, three and two consultations, respectively. Such 
gains in the timeliness of diagnosis could potentially be achievable 
if patients with different number of consultations present with 
similar symptoms. These illustrations should therefore be con- 
sidered to represent the theoretical maximum potential for 
improvement (in timeliness that could be achievable by reducing 
the number of pre-referral consultations) given the state of medical 
knowledge and system factors at the time of the audit period (such 
as the extent of access to specialist investigation available to general 
practitioners). 
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Table 2. Spearman's rank correlation co-efficient and ROC AUC values for the association between primary care interval and category of number of pre- 
referral consultations (n = 1 3 035) 






N 


Spearman's r 


Spearman's r 
P-value 


ROC area under 
the curve 3 


ROC area 95% 
lower CI 


ROC area 95% 
upper Ci 


All patients 


13035 


0.70 


< 0.0001 


0.88 


0.87 


0.89 


By cancer 


Breast 


2367 


0.56 




0.96 


0.93 


0.98 


Prostate 


2201 


0.55 




0.84 


0.82 


0.86 


Colorectal 


1999 


0.71 




0.86 


0.84 


0.88 


Luncj 


1421 


0.62 




0.83 


0.81 


0.86 


Melanoma 


735 


0.61 




0.87 


0.81 


0.94 


Bladder 


721 


0.72 




0.90 


0.87 


0.93 


Lymphoma 


590 


0.70 




0.87 


0.84 


0.90 


Oesophageal 


500 


0.75 




0.87 


0.84 


0.91 


Endometrial 


358 


0.64 


< 0.0001 b 


0.89 


0.84 


0.94 


Leukaemia 


358 


0.59 




0.81 


0.76 


0.87 


Ovarian 


324 


0.68 




0.86 


0.82 


0.91 


Pancreatic 


303 


0.71 




0.89 


0.85 


0.93 


Renal 


272 


0.60 




0.84 


0.79 


0.90 


Stomach 


237 


0.76 




0.88 


0.83 


0.92 


Oropharyngeal 


178 


0.72 




0.85 


0.79 


0.91 


Multiple myeloma 


176 


0.73 




0.88 


0.83 


0.93 


Brain 


159 


0.77 




0.92 


0.87 


0.96 


Unknown primary 


136 


0.76 




0.87 


0.81 


0.93 


By referral type 


'Two-week' referral 


8241 


0.72 




0.89 


0.88 


0.90 


'Emergency' 


1642 


0.72 


< 0.0001 b 


0.88 


0.87 


0.90 


'Routine' 


2030 


0.67 




0.85 


0.83 


0.87 


'Other' 


1122 


0.67 




0.88 


0.85 


0.90 


Abbreviations: AUC = area under curve; CI = confidence interval; ROC = receiver-operator characteristic. 

a For this analysis, the number of pre-referral consultations was dichotomised into 3 + vs 1-2 pre-referral consultation categories. Sensitivity analysis indicated that ROC AUC values were similar 
when other binary outcomes (e.g., '2 + ' vs 1, or '4 + ' vs 1, 2 or 3) were used, see Online Supplementary Information. 
^For any cancer type, and for any referral type. 



A correlation between pre-referral consultations and duration of 
primary care interval might be intuitive but evidence about this 
association is sparse (Bjerager et al, 2006). The findings 
corroborate evidence suggesting that suspecting the diagnosis of 
cancer is generally more challenging for cancers without specific 
symptoms (e.g., multiple myeloma, stomach cancer) compared 
with cancers with specific signs and symptoms (breast cancer, 
melanoma) (Rubin et al, 2011; Lyratzopoulos et al, 2012). 

Strengths of our study include its large sample size, the inclusion 
of patients with 18 different cancers and the use of a range of 
analytical approaches. There are several weaknesses. Some 
consultations may have been misclassified, either because of poor 
recording of presenting symptoms or misattribution of recorded 
symptoms — particularly in the context of co-morbidity (Weller 
et al, 2012). However, we judge that such errors are unlikely to 
have introduced substantial bias. Although there was no indepen- 
dent validation of the audit data, patients responding to the (2010) 
Cancer Patient Experience Survey reported similar patterns of 
variation by cancer in relation to the number of pre-referral 
consultations (Lyratzopoulos et al, 2012). Considering generalisa- 
bility, although patients included in the audit reflect national 
incidence statistics in respect of cancer type, age and sex (Rubin 



et al, 2011), it is conceivable that organisational factors and care 
quality in participating practices were different to other (non- 
participating) practices. Finally, we could not examine whether any 
of the prolonged values of either the primary care interval or the 
number of pre-referral consultations were either justifiable or 
preventable. 

A more liberal policy for referral and investigation of 
patients with non-specific symptoms may increase the number of 
cancer patients diagnosed after one or two consultations; 
but at the expense of additional patient anxiety and healthcare 
utilisation costs for patients who will be investigated but found 
not to have cancer. Wider access by general practitioners to 
specialist diagnostic tests is increasingly being advocated 
(Department of Health, 2012). There is a need to monitor 
the impact of general practitioner-led investigations on the 
promptness of diagnosis of cancer (and other pathologies) and 
on resource use. This can be achieved by a programme of 
primary care audit that encompasses use of diagnostic 
imaging or endoscopic investigations. Point-Of-Care diagnostic 
technologies can also have a part in reducing the number of 
consultations before referral, and such tests merit further 
development and evaluation. 
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The findings support efforts to improve the timeliness of 
diagnosis by improving the sensitivity of the appraisal of cancer 
symptoms by general practitioners, for example, using clinical 
decision support tools (Hamilton, 2009; Hippisley-Cox and 
Coupland, 2012). Raising awareness of the importance of persistent 
symptoms among patients may also help reduce between- 
consultation intervals (and therefore improve timeliness of 
diagnosis), although such improvements may not necessarily 
reduce the number of pre-referral consultations. Research and 
policy initiatives can be further prioritised, focusing on patients 
with cancers that are more 'difficult-to-suspect' because of poor 
symptom specificity (e.g., multiple myeloma, lung, stomach and 
pancreatic cancer), which are typically associated with longer 
primary care intervals and greater number of pre-referral 
consultations (Lyratzopoulos et al, 2012). 

In conclusion, both the number of pre-referral consultations 
and primary care interval are important measures of the timeliness 
of cancer diagnosis and are inter-related. Improving the sensitivity 
of symptom appraisal by general practitioners to detect cancer 
symptoms should be prioritised by research and policy initiatives. 
Development and evaluation of interventions can particularly focus 
on patients with difficult-to-suspect cancers. 
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